Stability of the entropy for superstatistics 
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Abstract 

The Boltzmann-Gibbs celebrated entropy Sbg = —kJ2iPi^ n Pi is concave 
(with regard to all probability distributions {pi}) and stable (under arbitrarily 
small deformations of any given probability distribution). It seems reasonable 
to consider these two properties as necessary for an entropic form to be a phys- 
ical one in the thermostatistical sense. Most known entropic forms (e.g., Renyi 

entropy) violate these conditions, in contrast with the basis of nonextensive 

l-V p q 

statistical mechanics, namely S q = k — _| - (q € 1Z; S± = Sbg), which sat- 
isfies both (Vg > 0). We have recently generalized S q (into S) in order to 
yield, through optimization, the Beck-Cohen superstatistics. We show here 
that S satisfies both conditions as well. Given the fact that the (experimen- 
tally observed) optimizing distributions are invariant through any monotonic 
function of the entropic form to be optimized, this might constitute a very 
strong criterion for identifying the physically correct entropy. 
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The Boltzmann-Gibbs (BG) entropy expression 



w 



Sbg = -k^pMp, 



•i i 



(1) 



i=i 



(sometimes referred to as the Boltzmann-Gibbs-Shannon entropy), and its equal-probability 
particular case Sbg — k In W, undoubtedly constitute a major step in human understanding 
of the underlying laws of nature. Its continuous form Sbg = —k J dxp(x) lnp(x), historically 
introduced by Boltzmann and Gibbs, its quantum form Sbg = —kTr pin p, introduced by 
von Neumann, and the above mentioned discrete form (1), introduced by Shannon (though in 
a different context), have been at the basis of invaluable scientific results in physics, chemistry 
and elsewhere. Let us learn more from it. The optimization of Eq. (1) under the canonical 
ensemble (equilibrium with a thermostat) constraints YliLiPi — 1 an d Y^LiPiEi = Ubg 
(Ubg is the internal energy, and {Ei} are the eigenvalues of the Hamiltonian), yields the 
celebrated BG probability for the equilibrium stationary state 



This distribution can always be, at least in principle, experimentally checked (and it has been 
so with well known success). Not so Sbg^ Although it normally goes without discussion, it is 
important to notice, for the arguments we want to develop here, that any monotonic function 
of Sbg ( e -g-> S^ G /k 2 ) would provide, through optimization, the very same distribution as Eq. 
(2). BG statistical mechanics is however much more than just the equilibrium distribution, 
and there are plethoric reasons for considering the physical entropy to be precisely Sbg an d 
no other function of it. We will quickly realize that the situation can become much less 
trivial as soon as we want to generalize BG statistical mechanics, in order to address other 
(typically nonergodic) stationary states such as those which ubiquitously emerge in complex 
systems. 

In order to handle nonequilibrium states of large classes of systems (examples nowadays 
known include turbulence [1-3], electron-positron annihilation [4], quark-gluon plasma [5], 
anomalously diffusing micro-organisms [6], classical [7] and quantum [8] chaos, long-range 



Pi oc e 



■ pEi ((3 = l/kT) 



(2) 
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many-body Hamiltonians [9], economics [10], and others; see [11] for reviews), one of us 
postulated [12] the entropic form 

1 _ y^w q 

S q = k (q eTZ; S 1 = S BG ) , (3) 

as the basis for generalizing BG statistical mechanics. It can be trivially verified that 
p(f B =P?xpf, V(t, j), implies S q (A + B)/k = S q (A)/k + S q (B)/k + (l-q)S q (A)S q (B)/k 2 , 
property which makes the generalized formalism to be sometimes referred to as nonextensive 
statistical mechanics. If we optimize S q with the already mentioned norm constraint and 
EZiPiEi/EZiPi = U q , we obtain [13] 

Pi oc e q PqEl , (4) 

where the g-exponential function is defined as e q = [1 + (1 — q)x\ 1 ^ 1 ~ q ^ [e\ = e x ), and (3' q is 
an effective inverse temperature. This distribution is ubiquitously detected in nature. The 
question arises: is S q the proper physical entropy for generalizing the BG formalism? Indeed, 
any monotonic function of S q , such as for example the Renyi entropy = [In £>?]/(! — 
q) — (1 — g) _1 ln[l + (1 — q)S q ] (we use k = 1 from now on), will also yield Eq. (4) if 
optimized under the same constraints. The answer seems to be yes. Indeed, S q is, Vg > 0, 
both concave (with regard to all probability distributions {pi}) and stable (under arbitrarily 
small deformations of any given probability distribution), whereas is not (like all other 
known entropic forms which are monotonic functions of S q ) [14,15]. 

The entropy Sbg can be obtained from appropriate set of axioms, as long shown by 
Shannon and also by Khinchin. However, the same occurs with S q and (and others) by 
modifying in admissible manners Shannon' s and/or Khinchin's sets of axioms [16]. Therefore 
this path does not help much for distinguishing the physical entropy from its monotonic 
functions. But concavity and stability do. Indeed, no monotonic function of S q is known 
which satisfies both. On top of this, S q allows, in all known cases (both vanishing and 
nonvanishing Lyapunov exponents, i.e., both zero and positive Kolmogorov-Sinai entropy), 
for finite entropy production per unit time [7], whereas the others do not. 
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Now, Wilk and Wlodarczyk [17] as well as Beck [2], noticed that Eq. (4) can be seen 
as the result of complex dynamics in stationary states associated with regions that exhibit 
spatio-temporal fluctuations of temperature. Such interpretation relies on the fact that 
e <? q 1 — Jo°° dfl e~P Ei f q (ff), where f q {0) is a x 2 distribution, the entropic index q being 
given by q = (f3 2 )/((3) 2 . Clearly, lim^x f q ((3) = 5((3 — (3[), where 5 represents Dirac's delta. 

Very recently, Beck and Cohen [18] made a further step along this line, which they called 
superstatistics ("statistics of statistics"). They introduced a generalized BG factor, namely 

POO 

B{E)= d(3e-P E f((3), (5) 
Jo 

where f(/3) is a generic admissible probability distribution of the stochastic inverse "tem- 
perature" satisfying J£°df3f(f3) = 1, and 

qsc = mi W , (6) 

where (...) = J °° d(3{. ..)/(/?). We have slightly modified their original notation, by adding 
the subindex BC (which stands for "Beck-Cohen"), in order to avoid confusion with q. If 
f(/3) is a x 2 ( or gamma) distribution, then q BC = q; otherwise, those are generically different 
quantities. 

The reason for considering the generalization (5) of the g-exponential weight appearing 
in nonextensive statistical mechanics basically is that, for systems with sufficiently complex 
dynamics, there is no a priori reason for not expecting the existence in nature of even more 
general distributions. The effective statistical mechanics of such systems will depend on 
the statistical properties of the fluctuations of the temperature, or of even other intensive 
quantities. Naturally, if there are no fluctuations of intensive quantities at all, the system 
must obey BG statistical mechanics (i.e., qsc = 9 = 1)- Beck and Cohen also showed 
that, for small variance of the fluctuations (i.e., \qBc ~ 1| << 1)> the first order correction 
to the BG statistics is the nonextensive statistics [12]. That is, the particular mechanism 
where nonextensivity is driven by relative small fluctuations of temperature is universal and 
precisely corresponds to nonextensive statistical mechanics with q = qsc- The whole idea 
was also illustrated with the uniform, bimodal, log-normal and F— distributions. 
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So far so good. But it is important to realize that having a generalized statistical weight 
such as (5) is not enough for having a statistical mechanics. Indeed, consistent expressions 
for the entropy S and for the internal energy U are also needed. By "consistent" we mean 
that the optimization of S with the norm and the energy constraints should yield Eq. (5). 
We have recently bridged this gap [19] and proposed the entropic functional S, as well as the 
associated energy constraint, so that superstatistics can be now derived from a variational 
principle within a statistical mechanical frame. Let us recall that any monotonic function of 
the entropic functional S introduced in [19] will also lead to Eq. (5). The entropy S seems, 
however, to be the physical one. Indeed, not only it is concave by construction [19], but it 
is also stable. The proof of the latter is the main result of the present paper. 

The entropic form S and the associated constraint for the internal energy U introduced 

in [19] are given by (from now on k = 1 for simplicity) 

w 

s = E ( s (Pi) > o; = s W = °) > (7) 
i=i 



and 



U (0 < ufa) < 1; u(0) = 0; u(l) = 1) . (8) 



For example, for the BG statistics, we have sbg(p) — ~ plnp and ubg(p) — V > an d, 
for the nonextensive statistics, we have s q (p) — (p — p q )/(q — 1) and u q (p) = p q . The 
function s(p) should generically have a definite concavity Vp G [0, 1]. Conditions (7) imply 
that S > and that certainty corresponds to S — 0. The function u{p) should generically 
be a monotonically increasing one. Certainty about Ej implies U — Ej. The quantity 
u (Pi)/ YljLi u (Pj) constitutes itself a probability distribution (the escort distribution [20]). 
Starting from the distribution of f(/3), we calculate B(E) and J °° dE'B(E'), and we find the 
inverse function, noted E(p), of p(E) = B(E)/ / °° dE'B(E'). Now, two cases are possible. 
The first one corresponds to distributions where the lowest admissible value of E(p) is 
E* — > — oo. In this case [19], u(p) = p and 

rp 

s(p) = ap + dxE(x) , (9) 
Jo 



where a = — Jq dxE{x). The second case corresponds to a finite and known value of E*. In 
this case, the final form of s(p) is given by [19] 

s(p) = E*[p + u(p)}, (10) 

where 



rp 

' i- 



dx 



«o>> = y- E T' ■ (in 

JO l-E(x)/E* 

Eqs. (9), (10) and (11) completely determine the formulation of the statistical mechanics 
associated with the Beck-Cohen superstatistics. 

For a statistical quantity 0{p) to be an observable, or physical quantity, a necessary 
condition [14] is that, under arbitrary small variations of the probabilities p, its relative 
variation remains small. We then say that 0{p) is stable. To be more precise, if we consider 
two probability sets p and p' associated with W microstates, the measure of the size of the 
deformation can be defined as follows [14] 

w 

\\p-p'\\=Y,\Pi-P'i\- (12) 

i=i 

The condition of stability of 0(p) is then given by 

0(p)-0( P >) 



\p-p'\ \ < 5 e 



< e (13) 



for any e > 0, with 5 e > being independent from W. This implies, in particular, that 
lim e ^ limvK^oo R = lim^-^oo hm^o R — 0. 

Using conditions (12) and (13), Lesche [14] showed that the Renyi entropies are unstable, 
and, therefore, cannot represent experimentally observable quantities (except, of course, for 
q — 1, when they recover the BG entropy, which is stable). Recently, using this formalism, 
Abe proved [21] that S g is stable and can consequently provide the physical entropic basis for 
the power-law distributions frequently observed in nature (Abe also pointed that another 
candidate, namely the so called normalized nonextensive entropies, are unstable, like the 
Renyi ones). It is along these lines that we shall now prove that S, as given by Eqs. (9), 
(10) and (11), is stable. 

6 



We first remark that B(E) is a physical generalization of the q -exponential factor (hence 
of the BG factor), and must therefore be a monotonically decreasing function; the same holds 
then for p(E) and for E(p). It immediately follows from Eq. (9) that 

w p . 

S(p) - S(p') = ]T / dxE(x) . (14) 
i=i M 

Notice that, since S(p) is concave, we can write S(\p + (1 — \)p') > \S(p) + (1 — \)S(p') 
(VO < A < 1). Since E(p) is positive and a monotonically decreasing function, it follows 
from Eq. (9) that F{p) = Jq dxE(x) is a concave monotonically increasing function. Using 
the monotonicity of E(x), if p i > p\ > 0, we have that 

f P ' dxE(x) = r P ' dxE(x + p'i) < r P ' dxE(x) = F{ Pi - ^), (15) 
Jp'. Jo Jo 

and, if p\> Pi> 0, we then have that 

j V% dxE(x) < - f P ' V% dxE(x) = -F(p' i - pX (16) 
Jp'i Jo 

Considering the upperbound, we can write that 



w 



\s(p)-s( P ')\<j: 



i=l 



[Pi 

/ dxE(x) 
Jp' 



w 



<Y.n\Pi-p'i\)- (17) 



On the other hand, from (10) we obtain 



w 



S{p)-S{p') = E*Y,HVi)-u{p[)]. (18) 
i=i 

Using that u(p) is a monotonically increasing function and that S(p) is concave, we can see 
from Eq. (10) that u(p) is a concave monotonically increasing function if E* > 0, and it 
is a convex monotonically increasing function if E* < 0. Hence, F'(p) = E*u(p) always 
is a concave monotonically increasing function. It follows that, if p i > p\ > 0, we have 
F'ipi) - FVi) < F 'iPi - Pd ,and, if p' l >p l > 0, we have -[F'( Pi ) - F'(j$] < F'fo - Pi ). 
This implies that \F'{ Pi ) - F'(jfi)\ < F'{\ Pi -p[\), then 

w w 

\S{P) - S{p')\ < E \F'{ Pi ) - F'(p>)\ < Enift - PJI) • (19) 
i=i i=i 



We now use that g(Xx)g(y) < g(x)g(Xy) for any increasing concave function g(x), with 



g(0) > 0, < x < y and < A < 1. Considering A 
[22], it follows that 



\p ~~ P'\ I < 1) x 



9(1) 



\p-p' 



if^ and y = 1 
lb-p'll y 



(20) 



Finally, since F{p) and F'{jp) are increasing concave functions, from Eqs.(17) and (19), if we 
identify g{p) as being F{p) or F'(p), we have 



\S(p)-S(p')\< 



g{\\p-p'\\) 

9(1) 



S 



\Pi~Pi\ 

lb-p'll 



+ 9(1) 



(21) 



Therefore, denoting by S max the maximal entropy, we obtain 

\S(p)-S(j/)\< 9{l b-*\\) [S max + g(l)\ . 



(22) 



This inequality shows that, for e > such that \S(p) — S(p')\ < eS max , we have that 
lb — p'|| < 5 e , which proves the stability of the entropy for superstatistics. 

Summarizing, the entropies introduced in Ref. [19] have been studied. Since they are 
simultaneously concave and stable, it is allowed to think that these entropies are physical 
ones, and as such can be used to formulate a proper statistical mechanics which further 
generalizes the current nonextensive statistical mechanics. The high precision experimental 
and numerical data for fully developed turbulence recently discussed by Beck [23] could well 
be an important physical application. 

Useful remarks from E. Brigatti are acknowledged, as well as partial support from 
PCI/MCT, CNPq, PRONEX/MCT and FAPERJ (Brazilian agencies). 
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